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Abstract 

The Douglas-Rachford algorithm is a popular method for finding zeros of sums of 
monotone operators. By its definition, the Douglas-Rachford operator is not sym¬ 
metric with respect to the order of the two operators. In this paper we provide a 
systematic study of the two possible Douglas-Rachford operators. We show that the 
reflectors of the underlying operators act as bijections between the fixed points sets of 
the two Douglas-Rachford operators. Some elegant formulae arise under additional 
assumptions. Various examples illustrate our results. 
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1 Introduction 


Throughout this paper we shall assume that X is a real Hilbert space, with inner product 
(•, •) and induced norm H-H. We also assume that A : X X and B : X X are 
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maximally monotone operator^ The resolvent and the reflected resolvent associated with 
A are = (Id +A)~^ and = 2}a— Id, respectivel}|^ The sum problem for A and B is 
to find X G X such that x G (A + When (A + B)“^(0) 7^ 0, the Douglas-Rachford 

splitting method can be used to solve the sum problem. The Douglas-Rachford splitting 
operator llTSi associated with the ordered pair of operators (A, B) is 

Ta,b := U^d+RBRA)=ld-}A + }BRA- (1) 

By definition, the Douglas-Rachford splitting operator is dependent on the order of the 
operators A and B, even though the sum problem remains unchanged when interchang¬ 
ing A and B. The goal of this paper is to investigate the connection between the operators Ta,b 
and Tb^a- Our main results can be summarized as follows. 

• We show that Ra is an isometri(0bijection from the fixed points set of g to that 
of Tb,a> with inverse Rg : Fix Tb^a ^ Fix Ta,b (see Theorem |2.1[ >. 

• When A is an affine relation, we have (Vn G IN) RaT^ g = j^R a- In particulaij^ 

when A = Nu where U is a closed affine subspace of X, we have (Vn G IN) = 
RaT^ aR-a arid = RaT^^Ra (see Proposition |2.4|[^i)| and Theorem |2.^[^i)[ ). 

• Our results coimect to the recent linear and finite convergence results (see Re¬ 
mark |2^ for the Douglas-Rachford algorithm (see |[T1, Q, ||Zl, HI, IITSi and (HI). 

In Section 1^ we present the main results and various examples. The notation we adopt is 
standard and follows, e.g., |0 and (201 . 


2 Results 

We recall that the Attouch-Thera dual pair of (A, B) (see (Sj) is the pair|^ (A-i,B-®). 
Following 0, we set Z := 'Z(^a,b) — (^ + F) ^(0) and K := K(^a,b) — ^ + B ®) ^(0), 

to denote, respectively, the primal and dual solutions. One easily verifies that 

Z(B,A) = (B + A)-H0) = Z and = (B-‘+ d-®)-'(0) =-K. (2) 

^ Recall that A : X X is monotone if whenever the pairs {x,u) and {y,v) lie in gra A we have {x — 
y,u — v) >0, and is maximally monotone if if is monofone and any proper enlargemenf of fhe graph of A (in 
ferms of sef inclusion) does nof preserve fhe monofonicify of A. 

^The identify operator on X is denofed by Id. If is well-known fhaf, when A is maximally monofone, }a 
is single-valued, maximally monofone and firmly nonexpansive and Ra is nonexpansive. 

^Suppose fhaf C and D are fwo nonempfy subsefs of X. We recall fhaf Q : C ^ D is an isomefry if 
(Vx e C)(Vi/ e C) II Qx — Qyll = ||x — i/||. The sef of fixed poinfs of T is FixT :={xeX|x = Tx}. 

^ Throughouf fhe paper we use Nq and Pq fo denote fhe normal cone and projector associafed wifh a 
nonempfy closed convex subsef C of X respecfively. 

5We sef A® := (- Id) o A o (- Id) and A"® := (A"!)® = (A®)-k 
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We further recall (see llT^ Lemma 2.6(iii)] and 0 Corollary 4.9]) that 
Z = }A(PixTA,B) and K = (Id-/A)(Fixr^,B), 
and we will make use of the following useful identity which can be verified using Q: 

RaTa,b — Tb,aRa = VaRa,b — }a — JaRbRa- (4) 

We are now ready for the first main result. 

Theorem 2.1. is an isometric bijection from Fix Ta,b io Fix Tb^A/ isometric inverse Rb- 
Moreover, we have the following commutative diagram: 


Fix Ta,b 


+ 


5 


a 

I 

S 

o 

> 


{A,B) 


Ra 


Rb 


Id x(-Id) 


Fix Tb,a 


+ 




Od 

HH 

o- 

I 

o 

[> 


[BA) 


Here S(^a,b) •= {(Z/ G X x X | — w G Bz,w G Az} is the extended solution sei|^/or the 
pair (A,B), and A: X —)• X x X: x i—)• {x,x). In particular, we have 

Ra : Fix Ta,b Fix Tb^a '■ z + k \-a- z — k, (5) 


where {z,k) G <S(a,b)- 

Proof Let x G X and note that Q implies that FixT^ g = PixRbRa and FixTg^^ = 
BixRaRb- Now x G FixT^ g x = RbRa^ Ra^ = RaRbRa^ X^x G 

Fix RaRb = Fix Tg which proves that Ra maps Fix Ta,b hito Fix Tb^a- hy interchanging 
A and B one sees that Xg maps Fix Tb^a into Fix g. We now show that Ra maps Fix Ta^b 
onto Fix Tb^a- To this end, let y G Fix Tb^a and note that Xg]/ ^ Fix Ta,b and X/^Xgy = y, 
which proves that Ra maps FixTy^^ g onto FixTg ,^. The same argument holds for Xg. 
Finally since (Vx G Fix Ta^b) RbRaX = x, this proves that Ra is a bijection from Fix Ta,b 

^For further information on the extended solution set, we refer the reader to IITSl Section 2.1]. 
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to Fix Tb^a with the desired inverse. To prove that Ra '■ Fix Ta,b Fix Tb^a is an isometry 
note that (Vx G FixT^^^g) (Vy G FixT^^g) we have ||x — y|| = ||i^gJ^^x — J^gR^y|| < 
\\Rax — RAyW < ||x —y||. 

We now turn to the diagram. The correspondence of Fix T^ g and Fix Tb^a follows from 
our earlier argument. The correspondences of Fix Ta,b and gp and Fix Tb,a and S(^b,a) 
follow from combining |0 Remark 3.9 and Theorem 4.5] applied to Ta,b and Tb^a respec¬ 
tively. The fourth correspondence is obvious from the definition of S(^j^^b) S^b,a)- 

To prove ^ we let y G Fix T^ g and recall that in view of ISl Theorem 4.5 and Re¬ 
mark 3.9] that y = z “ 1 “ where ( z , G b) and Ra (z + k) = (Ja - (Id -Ja))(z + k) = 
jA(z + k) - (Id- fA)(z + k) = z-k. m 

Remark 2.2. In view of BS] Remark 3.9, Theorem 4.5 and Corollary 5.5(iii)], when A and 
B are yaramonoton^ias is always the case when A and B are subdifferential operators of proper 
convex lower semicontinuous functions), we can replace <S(^a,b) ‘^(b,a) ^1/' respectively, Z x K 

and Z X (—K). 

Lemma 2.3. Suppose that A is an affine relation. Then 

(i) Ja is affine and JaRa = -Ja = RaJa- 
If A = Njj, where U is a closed affine subspace ofX, then we have additionally: 


(ii) Pu — Ja — JaRa — RaJa (i^d (Id —Ja)Ra — Ja — Id. 

(hi) R^ = Id, Ra = R)^^, cind Ra : X ^ X is an isometric bijection. 


Proof The fact that Ja is affine follows from [SI Theorem 2.1(xix)]. Hence JaRa = 
JA(2JA-Id)=2jl-JA = RAJA- 


(ii) It follows from [H Example 23.4] that Pu = Ja- Now using (i) we have RaJa = 


JaRa = 2P^ — Pu = 2Pu — Pu = Pu = /a- To prove the last identity note that by (i) 
have (Id -Ja)Ra = Ra - JaRa = 2Pu - Id +Pu = Pu - Id. 


we 


Ra = 2Pu — 2{Pu — Id) = Id. Finally let x,y G X. Since Ra is nonexpansive we have 
||x —y|| = ||R^x —R^yll < jjR^^x — R^^yH < ||x — y||, hence all the inequalities become 
equalities which completes the proof. ■ 


(hi) Because Ra is affine, it follows from (ii) that R\ = Ra(2Ja — Id) = 2RaJa — 


We now turn to the iterates of the Douglas-Rachford algorithm. 
Proposition 2.4. Suppose that A is an affine relation. Then the following hold: 
^ See flTl for definition and detailed discussion on paramonotone operators. 
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(i) (Vn G N) we have RaT^^ = a^a- 

(ii) RaZ = Ja Fix Tb,a and RaK = (Ja - Id) (- Fix 

If B is an affine relation, then we additionally have: 


(iii) Ta,bRbRa — RbRaTa,b- 

(iv) 4{Ta,bTb,a - Tb,aTa,b) = RbR\Rb - RaRIRa- Consequently, Ta,bTb,a = 
Tb,aTa,b RbR\Rb = RaR^Ra- 

(v) lfR\ = Rl= Id, therf\TA,BTB,A = Tb,aTa,b- 


Proof [(i)| It follows from (|4|), Lemma |Z^p)| and ([T|) that RaTa,b — Rb,aRa = '^}aTa,b — 

Ja-JaRbRa = }A{2TA,B-ld)-}ARBRA = /a( 2(J(Id+^ 5 ^, 4 )) - M) -= 

JaRbRa ~ JaRbRa = 0/ which proves the claim when n = 1. The general proof follows 
by induction. 


(ii) Using Lemma 2.c 'i) and Theorem 2.1 we have RaZ = RaJa(P^'x^Ta, 


,B) = 


UR^fF ixT^^ g ) = /, 4 (FixTg^^). Now using that the inverse resolvent identity]^ 

we obtain RyiR =(Fix T, 4 ^g) = 


Lemma 

~Ja-^Ra-^ 


2.2^ applied to A ^ and Theorem 2.1i we ootaui i\Ar^ — 

(FixT^^g) = -/^-i(-R^Fixr^,gy = (/a-I d)(-FixTg,^; 


(iii) Note that T^ g and Tb^a are affine. It follows from 0 that Ta,bRbRa = 


Ra,b{^Ra,b — Id) — — Ta,b — {ZTa,b — ^d)TA,B — RbRaTa,b- 

|(iv)| We have 


^Ta,bTb,a - Tb,aTa,b) = 4 (l(Id+RgR,4) 2 (Id+I^ aI^b) - J(Id+R,4i^B)2(Id TI^bI^a)) 

= Id +RbRa + RaRb + RbR\Rb ~ (Id +RaRb + RbRa 

+ RaR^Ra) = RbR^Rb ~ RaR^Ra- (6) 


(v) This is a direct consequence of (iii) 


With regards to Proposition |2.4[Ki)[ one may inquire whether the conclusion still holds 
when Ra is replaced by Rg. We now give an example illustrating that the answer to this 
question is negative. 

^ In passing, we point out that this is equivalent to saying that A = Nu and B = Ny where U and 
V are closed affine subspaces of X. Indeed, Rf = Id Ja = Ja srid fherefore we conclude fhaf 

ran Ja = Fix Ja- Combining wifh Il22l Theorem 1.2] yields fhaf Ja is a projecfion, hence A is an affine 
normal cone operator using ||6l Example 23.4]. 

^ Recall fhe when A is maximally monofone fhe inverse resolvenf idenfify sfafes fhaf Ja + U-i = Id. 
Consequently, R^-i = —Ra- 
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Example 2.5. Suppose that X = that LI = R x {0}, that V = {0} x R_|_, that A = Nu 
and that B = Ny. Then A is linear, hence however RbTa,b 7^ T^b,a^b 

RbTb,a 7 ^ Ta,bRb- 


n 


Proof. The identity RaTa,b = Tb,aRa follows from applying Proposition 2.4 p)| with 
= 1. Now let (x,i/) G R^. Elementary calculations show that R^(x,i/) = (x, —y). 

Consequently, Q implies that TA,B{^,y) = (0/]/^) and 
Therefore, RsT^^^x,!/) = (0,i/+), TB,ARB{x,y) = (0,0), 


and RB{x,y) = (—x, 

TBAi^'y) = (O'J/ 



RBTB,A{x,y) = (0, —y N'and bRb(x,i/) = (0, |y|). The conclusion then follows from 
comparing the last four equations. ■ 


We are now ready for our second main result. 

Theorem 2.6 (When A is normal cone of closed affine subspace). Suppose that U is a 
closed affine subspace and that A = Nu- Then the following hold: 


(i) (Vn G N) RaTI^ = TI^Ra, T^^ = RaTIb^a and Tf j, = RaT^a^a- 

(ii) Ra : Fix Tb^a ^ Fix Ta,b, Z = /a(F ix Tb,a), and K= {Ja- Id)(Fix Tb,a)- 

(hi) Suppose that V is a closed affine subspace of X and that B = Ny- Then Ta,bRaRb = 
RaRbTa,b and Ta,bTb,a = Tb,aTa,b- 


RaRaTJ^b = RaT^aRa- Hence T" gR,, = RaTI^RT^ = RaT^ 


Proof (i) Let n G N. It follows from Proposition 2^'i) 

JR 


and Lemma 


2.3 ;iii) 


that T” B 


A- 


(ii) 


^^ The statement for Ra follows from combining Theorem 2.1 and Lemma 2.3|(iii) 
In view of (|^, Lemma 2.3 Ii) and Theorem 2.1 one learns that Z = /,^(Fix Ta,b) = 
JaRa(P^^Ta,b) = /^(FixrB a)' Finally, 0, Lemma [2.3||^iii)| and j(ii)[ and Theorem |2.1 
ply that R= (ld-/A)(FixT^,B) = (Id -}a)Ra{Ra Fix Ta,b) = (^4 - Id) Fix Tb,a- 


im- 


(iii) In view of (i) applied to A and B we have Ta,bRaRb = RaTb,aRb = RaRbTa,b- 


The second identity follows from combining Proposition 2.4 V) and Lemma 2.3 lii) ap¬ 
plied to both A and B. 


The conclusion of Theorem 2.t lii) may fail when we assume that A or B is an affine, 
but not a normal cone, operator as we illustrate next. 

Example 2.7. Suppose that X = R^, that Lf = R x {0}, that A = Nu and that B = (11). 


Then B is linear and maximally monotone but not a normal cone operator and I 2 

Ta,bTba ^ Tb,aTa,b = liVi) 

^*^For every X e R, wesetx+ := max{x, 0} and x“ := min{x,0} 
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Figure 1: A GeoGebra IfT^ snapshot. Left: Two closed convex sets in R^, Lf is a linear 
subspace (green line) and V (the ball). Right: Two closed convex sets in U is the half¬ 
space (cyan region) and V (the ball). Shown are also the first five terms of the sequences 
(T^ gR^Xo)n 6 ]N (r^d points) and (rg^xo)w€N (blue points) in each case. The left figure 
illustrates Theorem 2.^|(i) while the right figure illustrates the failure of this result when 
the subspace is replaced by a cone. 


Corollary 2.8. Suppose that U is an affine subspace, that A = Njj and that Z 7 ^ 0 . Let x and y 
he in X. Then the following hold: 


(i) (Vn G N) = jATlBRAX,and (JaT^^x) neK converges weakly to a point in Z. 

(ii) \\TA,BX-TA,By\\ = \\Tb,aRaX - TB,ARAy\\ < \\RAX-RAy\\- 


Proof (i) It follows from Lemma 2.c 'iii) Proposition 2.4 'i) and Lemma 2.c li) that 
JaTb/^x = ]aTb/RaRaX = JaRa^abRaX = JaT^bRax, as claimed. The convergence of 
the sequence {Ja^b A'^)we]N follows from e.g., HU Theorem 25.6]. 


(ii) Apply Lemma [2.3|(iii) with x and y replaced with Ta,bX and TA,By> Proposition |2.4|[i)| 
with n = 1, and use nonexpansiveness of Tb^a- ® 


Remark 2.9. 


(i) The results of Theorem and Corollary |2.8| flrg of interest when the Douglas-Rachford 
method is applied to find the zero of the sum of more than two operators in which case one 
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can use a parallel splitting method (see e.g., Proposition 25.7]), where one operator is 
the normal cone operator of the diagonal subspace in a product space. 


(ii) A second glance at the proof of Theorem 2.61T) reveals that the result remains true if Jb is 
replaced by any operator Qb'- X ^ X (and Rb is replaced by 2Qb — Id, of course). This is 
interesting because in [ll, |2|, llTSi and I1T61I , Qb is chosen to be a selection of the (set-valued) 


projector onto a set V that is not convex. Hence the generalized variant of Theorem 2.i i) 
then guarantees that the orbits of the two Douglas-Rachford operators are related via 


(Vn G N) 


TIa = RaTIbRa. 


(7) 


(iii) As a consequence of (ii) and Lemma 2.3 'iii) we see that if linear convergence is guaran¬ 


teed for the iterates of T^^b then the same holds true for the iterates of Tb^a provided that 
U is a closed affine subspace, V is a nonempty closed set, A = Nu and Jb is a selection 
of the projection onto V. This is not particularly striking when we compare to sufficient 
conditions that are already symmetric in A and B (such as, e.g., ri LI n ri \7 fz 0 in ^ and 
mil); however, this is a new insight when the sufficient conditions are not symmetric (as 

in, e.g., mi, mni msi mn)- 


(iv) A comment similar to (iii) can be made for finite convergence results; see 11211 and f7l for 


nonsymmetric sufficient conditions. 


We now turn to the Borwein-Tam method lUTI . 

Proposition 2.10. Suppose that U is an affine subspace ofX, that A = Njj, and set 


R[a,b] ■— Ta,bTb,a- 

Then the following holds: 

(i) R[a,b] = RaT[b,a]Ra = {Ta,bRa)^ = {RaTb,a)^- 


( 8 ) 


(ii) Suppose that V is an affine subspace and that B 

sequently = {RbTa,b)^ = {Tb,aRb)^ = 

nonexpansive. 


Nv- Then 


11 


T, 


[A,B] 


= T 


\B,A]- 


Con- 


U^A,B + Tb,a)' is firmly 


Proof. Using (j^ and Theorem 2.i 1 ) with n = 1 we obtain R[a,b] — RaTb,aRaTb,a — 


RaTb,aTa,bRa — RaT[b a]Ra — Ta,bRaTa,bRa — {Ra,bRa) — (RaTba 


The identity ffA,B] — R[b,a] follows from Theorem 2.6 lii) and Now combine 


(ii) 

with 

firmlynonexpansive follows from the firm nonexpansiveness of Ta,b arid Tg ^ and the 


(i) with A and B switched, and use HTTl Remark 4.ij. lhat (hence R[b,a]) i^ 


11 


See IIH Proposition 3.5] for the case when U and V are linear subspaces. 
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fact that the class of firmly nonexpansive operators is closed under convex combinations 
(see, e.g., [61 Example 4.31]). ■ 

Following [TTI . the Borwetn-Tam method specialized to two nonempty closed convex 
subsets U and V of X, iterates the operator T^a,b] where A = Nu and B = Ny- We 

conclude with an example that shows that if A or B is not an affine normal cone operator 
then T^a,b] T^b,a] need not be firmly nonexpansive. 

Example 2.11. Suppose that X = that U = R+ • (1,1), that R = R x {0}, that A = Nu 
and that B = Ny. Then neither T^a,b] T^b,a] is firmly nonexpansive. 

Proof. Let {x,y) G R^. Using Q we verify that TA,Bix,y) = A v)^rV — A v)^) 
and Tg^Ai^^y) = “ !/)"^/!/ + ~ y)~^)- Now let a; > 0 , let x = (—2x,2a) and 

lety = (0,0). A routine calculation shows that T[^ g]X = ,i(—2A;,2a;) = (x,x) and 

T[A,B]y = East’s,A(0 ,0) = (0,0),hence “ E[As]y/(M-E[^, b])^ - (Id-E[^,s])y) = 

{{Di,Di),{—2>Ci,Di)) = —2cP- < 0. Applying similar argument to T^b,a] with x = 

(-2x, -2x) and y = (0,0) shows that (Ejs a]X - T[B,A]y> (Id -E[b,a])^ - (Id -E[B,A])y) = 
((—3x, —x), (x, —x)) = —2x^ < 0. It then follows from e.g., [H Proposition 4.2] that 
neither E[a,b] nor E[b,a] Is firmly nonexpansive. ■ 
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